"Airbnb began in 2008 when two designers who had space to share hosted three travelers looking for a place to stay. Now, millions of hosts and travelers choose to create a free Airbnb account so they can list their space and book unique accommodations anywhere in the world. And Airbnb experience hosts share their passions and interests with both travelers and locals."
"Airbnb helps make sharing easy, enjoyable, and safe. We verify personal profiles and listings, maintain a smart messaging system so hosts and guests can communicate with certainty, and manage a trusted platform to collect and transfer payments."
The source of the data is kaggle.com. The data used in this analysis is for two cities: Boston and Seattle
The data files are for calendar, reviews and listings. The listings datafile contains one observation per listings, with information related to: Basic information (location, space, host, images (of listing and host), availability), Reviews, and Price. The calendar and reviews datafiles contain multiple entries per listing relating to individual availability data and reviews.
For anyone new to AirBnB (like me), the most obvious questions relate to:
365.0
We can plot the locations for AirBnB listings for both Boston and Seattle. Surprisingly (for me) there are listings dotted around each city.
The breakdown of prices per zipcode for each city is:
Where the prices in red are for zipcodes where the price is at or below the 25th percentile.
| listing_id | date | available | price | city | |
|---|---|---|---|---|---|
| 1473187 | 10274175 | 2016-02-20 | t | $46.00 | Seattle |
| 1476002 | 8193332 | 2016-11-06 | t | $100.00 | Seattle |
| 1330041 | 3269390 | 2016-12-15 | t | $95.00 | Seattle |
| 2112622 | 7713043 | 2016-01-06 | t | $75.00 | Seattle |
| 23788 | 12806707 | 2017-07-04 | t | $60.00 | Boston |
| listing_id | id | date | reviewer_id | reviewer_name | comments | city | |
|---|---|---|---|---|---|---|---|
| 43699 | 2746782 | 38121292 | 2015-07-13 | 28180522 | Anita | We checked in very late on Friday and since we approached from the street above the property, walking down the stairway, we had to disturb Jean-Marc to make sure we had the right place. He was very gracious and welcoming.\r\n\r\nThis unit was very clean, and just as pictured. The location is quiet and private, and since we came back rather late at night, we were happy not to disturb anyone. The bed was very comfortable and was appreciated after our busy days in Seattle. Great coffee with the Keurig, and the refrigerator and microwave would have been used, but we were hardly there! | Seattle |
| 134473 | 8523157 | 83104785 | 2016-07-01 | 75099287 | Jon | The hosts were great. They provided outstanding communication before and during the trip. They offered suggestions about where to go and where to eat. The accommodations provided were immaculate and spacious. WARNING: you will fall in love with the cat and dogs. I returned two additional times due to the pets and hospitality. Thanks! | Boston |
| 14338 | 1796302 | 10641558 | 2014-03-01 | 11918488 | Meredith | Susanna was a fantastic hostess during my recent stay. She was accessible and accommodating, and I felt welcome from the moment we first communicated. Her home is lovely, her pets are sweet, and her local knowledge is impressive. She provided expert guidance on everything from restaurants to city-wide transit, and she made sure my friend and I had everything we needed at all times. I'll certainly plan my next trip to Seattle around Susanna's availability. I can't imagine staying anywhere else! | Seattle |
| 89471 | 3601424 | 32554893 | 2015-05-19 | 21341343 | Crystal | Erin was an extremely gracious host. The room was spacious and had plenty of storage for all of our luggage and clothing. We weren't at the home much, but we're thankful that we could come in after a long day and get straight to rest! Room was comfy and the house was clean! | Boston |
| 62799 | 7305969 | 53210004 | 2015-11-06 | 11489767 | Amy | Emily was a great hostess and made me feel right at home with anything I needed and great recommendations. | Seattle |
We have seen that the reviews are mostly positive. We are going analyze the reviews to see the sentiments expressed in the review. We are going use natural language process to scan each of the reviews for key "sentiments" that are expressed in the reviews.
We will do this in three ways.
The results for the positive reviews are not too surprising, the results for the negative sentiments are shocking.
Let's scan through some of the reviews to see where the words die, rob, killer and war appear. It turns out, we only need to look at the one example of each to see why those apparently shocking terms are used.
So some of the reviews are not in english, and some of the "sentiments" detected are due to colloquial usages. First, let's remove the non-english reviews.
Surprisingly, "die" remains, but "kller" (which is mainly english colloquial) doesn't. Unsurprisingly, "rob" still remains. Let's see why "die" is used.
Ok, more colloquial usage, what about "killer"?
Grouped by city, english language only: Time Taken: 303.38720989227295 seconds
loaded from pickle: Time Taken: 15.748566150665283 secondsNone
[]
[]
[]
All listings, in the listings data, are in the calendar data file. But close to 19% are missing from the reviews data.
['number_of_reviews', 'first_review', 'last_review', 'review_scores_rating', 'review_scores_accuracy', 'review_scores_cleanliness', 'review_scores_checkin', 'review_scores_communication', 'review_scores_location', 'review_scores_value', 'reviews_per_month', 'Review Scores Rating Percentiles']
1383
count 7403.00 mean 147.80 std 102.89 min 0.00 0% 0.00 10% 55.00 20% 70.00 30% 85.00 40% 100.00 50% 120.00 60% 145.00 70% 170.00 80% 200.00 90% 275.00 100% 999.00 max 999.00 Name: price, dtype: float64
city_merge
Boston 127.976
Seattle 173.926
Name: price, dtype: float64| count | mean | std | min | 25% | 50% | 75% | max | |
|---|---|---|---|---|---|---|---|---|
| listing_id | 2702460.00 | 6950804.94 | 4052439.85 | 3335.00 | 3865312.75 | 7035369.00 | 9504211.25 | 14933461.00 |
| price | 1577579.00 | 162.60 | 143.70 | 10.00 | 79.00 | 120.00 | 200.00 | 7163.00 |
| year | 2702460.00 | 2016.33 | 0.47 | 2016.00 | 2016.00 | 2016.00 | 2017.00 | 2017.00 |
| count | mean | std | min | 25% | 50% | 75% | max | |
|---|---|---|---|---|---|---|---|---|
| id | 7403.00 | 6950001.48 | 4052396.78 | 3335.00 | 3864099.50 | 7035240.00 | 9500804.00 | 14933461.00 |
| scrape_id | 7403.00 | 20160492479532.68 | 400929617.51 | 20160104002432.00 | 20160104002432.00 | 20160104002432.00 | 20160906204935.00 | 20160906204935.00 |
| host_id | 7403.00 | 20210534.87 | 19623093.35 | 4193.00 | 4343163.50 | 14486505.00 | 30283594.00 | 93854106.00 |
| host_listings_count | 7401.00 | 32.22 | 123.59 | 0.00 | 1.00 | 1.00 | 4.00 | 749.00 |
| host_total_listings_count | 7401.00 | 32.22 | 123.59 | 0.00 | 1.00 | 1.00 | 4.00 | 749.00 |
| latitude | 7403.00 | 45.07 | 2.64 | 42.24 | 42.35 | 47.54 | 47.62 | 47.73 |
| longitude | 7403.00 | -97.52 | 25.61 | -122.42 | -122.33 | -122.28 | -71.08 | -71.00 |
| accommodates | 7403.00 | 3.20 | 1.89 | 1.00 | 2.00 | 2.00 | 4.00 | 16.00 |
| bathrooms | 7373.00 | 1.24 | 0.55 | 0.00 | 1.00 | 1.00 | 1.00 | 8.00 |
| bedrooms | 7387.00 | 1.28 | 0.82 | 0.00 | 1.00 | 1.00 | 2.00 | 7.00 |
| beds | 7393.00 | 1.67 | 1.08 | 0.00 | 1.00 | 1.00 | 2.00 | 16.00 |
| square_feet | 153.00 | 856.03 | 647.19 | 0.00 | 420.00 | 770.00 | 1200.00 | 3000.00 |
| price | 7403.00 | 147.80 | 102.89 | 0.00 | 79.00 | 120.00 | 189.00 | 999.00 |
| guests_included | 7403.00 | 1.56 | 1.20 | 0.00 | 1.00 | 1.00 | 2.00 | 15.00 |
| minimum_nights | 7403.00 | 2.76 | 13.24 | 1.00 | 1.00 | 2.00 | 3.00 | 1000.00 |
| maximum_nights | 7403.00 | 14313.37 | 1162232.13 | 1.00 | 95.50 | 1125.00 | 1125.00 | 99999999.00 |
| availability_30 | 7403.00 | 12.85 | 12.07 | 0.00 | 0.00 | 10.00 | 26.00 | 30.00 |
| availability_60 | 7403.00 | 29.56 | 23.84 | 0.00 | 1.00 | 31.00 | 55.00 | 60.00 |
| availability_90 | 7403.00 | 48.63 | 35.01 | 0.00 | 7.00 | 56.00 | 84.00 | 90.00 |
| availability_365 | 7403.00 | 213.09 | 138.34 | 0.00 | 77.00 | 259.00 | 347.00 | 365.00 |
| number_of_reviews | 7403.00 | 20.68 | 36.73 | 0.00 | 1.00 | 7.00 | 23.00 | 474.00 |
| review_scores_rating | 5943.00 | 93.32 | 8.21 | 20.00 | 91.00 | 96.00 | 99.00 | 100.00 |
| review_scores_accuracy | 5922.00 | 9.54 | 0.82 | 2.00 | 9.00 | 10.00 | 10.00 | 10.00 |
| review_scores_cleanliness | 5932.00 | 9.42 | 1.00 | 2.00 | 9.00 | 10.00 | 10.00 | 10.00 |
| review_scores_checkin | 5925.00 | 9.72 | 0.68 | 2.00 | 10.00 | 10.00 | 10.00 | 10.00 |
| review_scores_communication | 5934.00 | 9.73 | 0.66 | 2.00 | 10.00 | 10.00 | 10.00 | 10.00 |
| review_scores_location | 5926.00 | 9.52 | 0.78 | 2.00 | 9.00 | 10.00 | 10.00 | 10.00 |
| review_scores_value | 5926.00 | 9.32 | 0.89 | 2.00 | 9.00 | 9.00 | 10.00 | 10.00 |
| license | 0.00 | NaN | NaN | NaN | NaN | NaN | NaN | NaN |
| calculated_host_listings_count | 7403.00 | 7.69 | 21.47 | 1.00 | 1.00 | 1.00 | 3.00 | 136.00 |
| reviews_per_month | 6020.00 | 2.03 | 1.97 | 0.01 | 0.59 | 1.37 | 2.89 | 19.15 |
| year | 7403.00 | 2016.00 | 0.00 | 2016.00 | 2016.00 | 2016.00 | 2016.00 | 2016.00 |
| count | mean | std | min | 25% | 50% | 75% | max | |
|---|---|---|---|---|---|---|---|---|
| listing_id | 153124.00 | 3787517.47 | 3248161.22 | 3353.00 | 1071843.00 | 3139972.00 | 5958674.00 | 14843783.00 |
| id | 153124.00 | 40342403.39 | 24778966.56 | 1021.00 | 20620259.75 | 38463998.00 | 53978187.50 | 99990454.00 |
| reviewer_id | 153124.00 | 21922545.05 | 18816034.68 | 15.00 | 6342335.75 | 17552614.00 | 32977175.50 | 93350341.00 |
| year | 153124.00 | 2014.72 | 1.06 | 2009.00 | 2014.00 | 2015.00 | 2015.00 | 2016.00 |
| 0 | |
|---|---|
| id | 12147973 |
| listing_url | https://www.airbnb.com/rooms/12147973 |
| scrape_id | 20160906204935 |
| last_scraped | 2016-09-07 00:00:00 |
| name | Sunny Bungalow in the City |
| summary | Cozy, sunny, family home. Master bedroom high ceilings. Deck, garden with hens, beehives & play structure. Short walk to charming village with attractive stores, groceries & local restaurants. Friendly neighborhood. Access public transportation. |
| space | The house has an open and cozy feel at the same time. The living room has a flat screen TV. The kitchen has all you need for cooking. We prefer you buy your food but can use the organic oils, herbs, etc. The yard can be seen from sitting room and when the weather allows, the yard is a place children can lose themselves in a safe way. We have 2 bee hives, 6 hens fenced in (sometimes they get out of their coop area & into the yard), 2 rabbits in a hutch and play structure. |
| description | Cozy, sunny, family home. Master bedroom high ceilings. Deck, garden with hens, beehives & play structure. Short walk to charming village with attractive stores, groceries & local restaurants. Friendly neighborhood. Access public transportation. The house has an open and cozy feel at the same time. The living room has a flat screen TV. The kitchen has all you need for cooking. We prefer you buy your food but can use the organic oils, herbs, etc. The yard can be seen from sitting room and when the weather allows, the yard is a place children can lose themselves in a safe way. We have 2 bee hives, 6 hens fenced in (sometimes they get out of their coop area & into the yard), 2 rabbits in a hutch and play structure. You will have access to 2 bedrooms, a living room, kitchen, bathrooms, and yard. Roslindale is quiet, convenient and friendly. For Southern food try Redd's in Rozzie. Italian Delfino's or Sophia's Grotto are great. Birch St Bistro has nice atmostphere--a little pric |
| experiences_offered | none |
| neighborhood_overview | Roslindale is quiet, convenient and friendly. For Southern food try Redd's in Rozzie. Italian Delfino's or Sophia's Grotto are great. Birch St Bistro has nice atmostphere--a little pricier. If you are cooking the Fish Market has fresh fish daily; Tony's makes his own sausages and has Italian foods; for a wide variety of delicious cheeses and chocolates go to the Cheese Cellar on Birch St. |
| notes | NaN |
| transit | The bus stop is 2 blocks away, and frequent. Bus is about a 10 minute ride to the Orange line, forest hills. The commuter rail into down town is a 6 minute walk from our home. Walking is pleasant and restaurants, shops and grocery store are all a 6 minute walk away. |
| access | You will have access to 2 bedrooms, a living room, kitchen, bathrooms, and yard. |
| interaction | NaN |
| house_rules | Clean up and treat the home the way you'd like your home to be treated. No smoking. |
| thumbnail_url | https://a2.muscache.com/im/pictures/c0842db1-ee98-4fe8-870b-d1e2af33855d.jpg?aki_policy=small |
| medium_url | https://a2.muscache.com/im/pictures/c0842db1-ee98-4fe8-870b-d1e2af33855d.jpg?aki_policy=medium |
| picture_url | https://a2.muscache.com/im/pictures/c0842db1-ee98-4fe8-870b-d1e2af33855d.jpg?aki_policy=large |
| xl_picture_url | https://a2.muscache.com/im/pictures/c0842db1-ee98-4fe8-870b-d1e2af33855d.jpg?aki_policy=x_large |
| host_id | 31303940 |
| host_url | https://www.airbnb.com/users/show/31303940 |
| host_name | Virginia |
| host_since | 2015-04-15 |
| host_location | Boston, Massachusetts, United States |
| host_about | We are country and city connecting in our deck and garden. Enjoy our music room, books and flat screen TV with the pastoral backyard of hens, bees, rabbits and an organic garden. |
| host_response_time | NaN |
| host_response_rate | NaN |
| host_acceptance_rate | NaN |
| host_is_superhost | f |
| host_thumbnail_url | https://a2.muscache.com/im/pictures/5936fef0-ba16-45bd-ac33-9226137d0763.jpg?aki_policy=profile_small |
| host_picture_url | https://a2.muscache.com/im/pictures/5936fef0-ba16-45bd-ac33-9226137d0763.jpg?aki_policy=profile_x_medium |
| host_neighbourhood | Roslindale |
| host_listings_count | 1.0 |
| host_total_listings_count | 1.0 |
| host_verifications | ['email', 'phone', 'facebook', 'reviews'] |
| host_has_profile_pic | t |
| host_identity_verified | f |
| street | Birch Street, Boston, MA 02131, United States |
| neighbourhood | Roslindale |
| neighbourhood_cleansed | Roslindale |
| neighbourhood_group_cleansed | NaN |
| city | Boston |
| state | MA |
| zipcode | 02131 |
| market | Boston |
| smart_location | Boston, MA |
| country_code | US |
| country | United States |
| latitude | 42.28 |
| longitude | -71.13 |
| is_location_exact | t |
| property_type | House |
| room_type | Entire home/apt |
| accommodates | 4 |
| bathrooms | 1.5 |
| bedrooms | 2.0 |
| beds | 3.0 |
| bed_type | Real Bed |
| amenities | {TV,"Wireless Internet",Kitchen,"Free Parking on Premises","Pets live on this property",Dog(s),Heating,"Family/Kid Friendly",Washer,Dryer,"Smoke Detector","Fire Extinguisher",Essentials,Shampoo,"Laptop Friendly Workspace"} |
| square_feet | NaN |
| price | 250.0 |
| weekly_price | NaN |
| monthly_price | NaN |
| security_deposit | NaN |
| cleaning_fee | $35.00 |
| guests_included | 1 |
| extra_people | $0.00 |
| minimum_nights | 2 |
| maximum_nights | 1125 |
| calendar_updated | 2 weeks ago |
| has_availability | NaN |
| availability_30 | 0 |
| availability_60 | 0 |
| availability_90 | 0 |
| availability_365 | 0 |
| calendar_last_scraped | 2016-09-06 |
| number_of_reviews | 0 |
| first_review | NaN |
| last_review | NaN |
| review_scores_rating | NaN |
| review_scores_accuracy | NaN |
| review_scores_cleanliness | NaN |
| review_scores_checkin | NaN |
| review_scores_communication | NaN |
| review_scores_location | NaN |
| review_scores_value | NaN |
| requires_license | f |
| license | NaN |
| jurisdiction_names | NaN |
| instant_bookable | f |
| cancellation_policy | moderate |
| require_guest_profile_picture | f |
| require_guest_phone_verification | f |
| calculated_host_listings_count | 1 |
| reviews_per_month | NaN |
| Review Scores Rating Percentiles | NaN |
| year | 2016 |
| month | September |
| day | Wednesday |
[NbConvertApp] Converting notebook p1_blog_airBnB.ipynb to html [NbConvertApp] Writing 10172346 bytes to p1_blog_airBnB.html
[NbConvertApp] Converting notebook p1_blog_airBnB.ipynb to markdown [NbConvertApp] Support files will be in p1_blog_airBnB_files/ [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Making directory p1_blog_airBnB_files [NbConvertApp] Writing 44420 bytes to p1_blog_airBnB.md
[NbConvertApp] Converting notebook p1_blog_airBnB.ipynb to html [NbConvertApp] Writing 10000359 bytes to p1_blog_airBnB.html
[NbConvertApp] Converting notebook p1_blog_airBnB.ipynb to html [NbConvertApp] Writing 10005527 bytes to p1_blog_airBnB.html